Statistical networks emerging from link-node interactions 
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We study a model for a statistical network formed by interactions between its nodes and links. 
Each node can be in one of two states (Ising spin up or down) and the node-link interaction facilitates 
linking between the like nodes. For high temperatures the influence of the nodes on the links can 
be neglected, and we get the Ising ferromagnet on the random (Erdos-Renyi) graph. For low 
temperatures the nodes get spontaneously ordered. Due to this, the connectivity of the network 
enhances and links having a common node are correlated. The emerged network is clustered. The 
node-link interaction shifts the percolation threshold of the random graph to much smaller values, 
and the very percolation transition can become of the first order: the giant cluster coexist with the 
unconnected phase leading to bistability and hysteresis. The model can be applied to the striction 
phenomena in magnets and to studying opinion formation in the sociophysical context. 

PACS numbers: 64.60.Cn, 89.75.Hc, 89.65.-s 



Statistical mechanics of networks is a growing field 
with a wide range of applications The subject orig- 
inated with works of chemical physicists and mathe- 
maticians |3j , while the modern trends focus on interdis- 
ciplinary applications (biology, social sciences) Q]. 

Normally networks are modeled either via passive 
nodes with a given distribution of links, or with a given 
dynamics of link formation (growing network) y|. One 
of the basic models in the first class is the random (Er- 
dos and Renyi) graph 0, a set of N nodes with 
the links independently distributed between them. The 
model adequately describes some (e.g., percolation) but 
not all the relevant features of the real networks (e.g., 
clustering). This motivated generalizations of the ran- 
dom graphs within statistical mechanics of networks Q . 

Here we propose to model a network such that its nodes 
and links are active variables influencing each other. We 
present below possible applications of this approach. 

Consider N labeled nodes which carry Ising spins 
a = {<7j = ±1}^ X . Linking between these nodes is de- 
scribed by the symmetric adjacency matrix J = {Jik}- 
Jik = Jhi — 1(0) indicate on the presence (absence) of the 
corresponding undirected link. No self-links are present 
J a — 0. The Hamiltonian of the system is 



H(a, J) = -7> JikOi<Jk 

— <%<k 



■<*y\.Jik, 



(i) 



where 7 is the coupling of the link-node interaction, while 
the second term with a > generates (for 7 = 0) the 
proper random graph behavior. For 7 > (ferromag- 
net) linking between the like nodes o~iOk > is favored. 
Likewise, if Jik = 1, then 0$ and ak tend to line up. 

We assume that i) J and a are statistical systems 
with different times-scales: spins (links) are fast (slow); 
ii) J and a may have different temperatures. For 
constructing the stationary distribution in the spirit 
of the information-theoretical approach Q we intro- 
duce the entropies of the links and spins 0: Sj = 
-TrjP(J)]nP(J), S a = -TrjlT^PH^lnPHJ)], 



where Trj (Tr CT ) is the summation over all configura- 
tions of J (a). P(J) and P(a\J) are, respectively, 
the probability of the links and the conditional prob- 
ability of the spins. Due to the above assumption i) 
the relevant probability for the spins is P(a\J), and 
thus S a is the relevant conditional entropy. P(J) and 
P(o~\J) are found by minimizing the average energy 
U = TrjTr a H{a, J)P{J)P(a\J) for the fixed values of 
Sj and S a . To this end minimize the Lagrange function 
U - T a S a - TjSj, with T a = and T, = 1/(3., being 
the Lagrange factors or temperatures 0: 



P(a\J) 



-0 a H[a,J) 



Z{J) = Tr CT e 



(2) 



P(J) = Z- 1 Z n (J), Z=TrjZ n (J), n = TjTj,(3) 

where — T a In Z(J) is an effective Hamiltonian forming a 
Gibbs distribution at temperature Tj for P(J). 

Alternatively, we can recover J21 via the microscopic 
approach 0, 0, 111 subjecting J and a to thermal baths 
at temperatures Tj and T a , respectively. 

Limiting cases. For 7 = (no spins thus passive nodes) 
we get from P(J) the standard random graph with the 
links Jik independently assuming values and 1 with the 
probabilities, respectively, 1 — -fe and jj. Here c is finite 
for N 3> 1 and is found from 



a(3j = In ([N — c]/c) . 



(4) 



Since links can be formed between any pair of the nodes, 
most of Jik have to be zero to ensure a finite average 
connectivity: J2k(Jik) = c - 

When n = T a /Tj — * 0, but c (and thus a(3j) is fixed, 
the nodes do not react on the links which still form the 
random graph. The Ising model on the random graph 
(which simulates disordered media) is widely employed 
for studying magnets, lattice gases, etc, [9|,ll0|. Finite n 
describes situations, where the reaction of the spins on 
the lattice is important, e.g., the striction effect. For or- 



2 



dered lattices such effects were studied in detail the 
present model describes striction for a disordered lattice. 

Phase structure. We calculate Z in via the no- 
torious replica method 0, i.e., first taking n = T a /Tj 
integer and then analytically continuing to a real n: 



Z = Ti a .je- p ^=i H{aaj) = Tr CT e^ 



We now apply the identity (r a = ±1) 

n 

e ^ELl T » =b +J2 b r E T ^- T ^ ( 5 ) 
r— 1 ai<...<a r 

b r = Tr r (ri.-.Tve^KU^) = tanh r (/3 7 ) cosh™(/3 7 ), 
and employ e ax2 / 2 = J M* e -v*/2+V5xv : 



« n 

z = / n n ^N^dQ 



a—1 ai<...<a 



— 'r= 1 * — *ai<...<a r 



In Tiv exp 



^ ^ C6 r Qai...a r ^ai ■■■^a r 



,r=l ai<...<a r 



(0) 



(7) 



_F is the thermodynamic potential of the problem [6j. 
The values of Q ai ...a r are found from treating the integral 
in JHl via the saddle-point method, where one searches 
the deepest minima of F(Q) (necessarily, d Q dF — = 0). 
For situations of our interest the replica symmetry holds, 
i.e., Q ai ...a r depend only on the number of the replicas: 
Qa!...a r — Q • Since all nodes are equivalent [9|, 



=Tr jP(J) [Tr a P(a\J)<j} r . 



(8) 



For an arbitrary n we have to involve all Q ai ...a r , which 
makes the explicit analysis rather difficult. Things are 
simpler for n — 1,2, where at best only two parame- 
ters are involved Qi = M (magnetization) and Qi 2 = Q 
(Edwards- Anderson parameter [tj). For n = 1 the as- 
sumption on the wide separation of characteristic times is 
irrelevant, because P(<J, J) is a Gibbsian at temperature 
T a = Tj and does not depend at all on the characteristic 
times. We get from (JHUZJ): 



F = 



cb^l 2 



ln[2cosh(c6iM)], M = tanh(c& x M), (9) 



where the behavior of M is controlled by a single param- 
eter cb\\ for cbi < 1 the only solution is M = 0, while for 
c&i > 1 we have a smooth (second-order) transition to 
the ferromagnetic phase, where M ^ 0. Eq. © admits 
two ferromagnetic solutions with ±M. At the transition 
point one of these values is chosen randomly. The choice 
can be made deterministic by applying a small magnetic 
field h, i.e., by adding hY^Li a % {h <C J) to the Hamilto- 
nian. We can get cbi > 1 by increasing the spin-link cou- 
pling 7, or decreasing T a with constant n and c (thermal 



phase transitions). The presence of macroscopic (oc N) 
cluster of connected nodes (giant component) is neces- 
sary for a thermal phase transition. In the percolation 
limit thermal fluctuations are absent: T ai Tj — > 0, while 
n and cb r are fixed. As seen from @ this requires very 
small connectivity c. Then cb r — c e does not depend on 
r. Eq.© then shows that the ferromagnet appears via 
second-order phase transition for c e = 1. The presence 
of the giant component is necessary and sufficient for the 
percolational phase transition. 

Second-order thermal transitions can be studied for an 
arbitrary n. Next to such a transition Tr CT [P (oj J) <7j] is 
small, and © implies 1 ^> M ^> Q. Expanding F in Q 

and M (Ginzburg-Landau expansion) and solving ^ = 

2 

so that Q = x ^ ch b\b 2 M is expressed via M, gives 



F = AqM + A4M , 
A Q = _i_(i_c6i), A 4 



nc 4 6f[l-c6 2 (3n-2)] 
12(1 -cb 2 ) ' 



(10) 
(11) 



At high temperatures both Aq and A4 are positive, and F 
is minimal for M — Q — (paramagnet) . Aq changes its 
sign at c&i = 1, i.e, at ct — (1 — t 2 )? , where t = tanh7/3 CT . 
Then A4 > is equivalent to 1 > (in — 2)t. Thus for 
n < 1, A4, > for Ao ~ that means a second-order 
transition to ferromagnet: at cbi > 1, F in H10|) changes 
from monostable to the bistable shape with non-zero M 
and Q. For n > 1 this behavior is true for sufficiently 
large c, e.g., for n = 2 conditions ct = (1 — t 2 ) and 
1 > (in — 2)t lead to c > 15/4. For smaller c, however, 
A4 changes its sign before Aq which indicate on first- 
order transition as the next case n = 2 shows. Here we 
have three order parameters Q\, Q2 and Q12 = Q. The 
deepest minima of F corresponds to Q\ = Q2 = M, 



F = cb x M 2 



cb 2 Q(Q - 2) 



- ln(2^), 



-2cb 2 Q 



(12) 
,(13) 



tpM = sinh(2c6iAf), tpQ = cosh(2c6iM) - e 

where Eas. l|13fl is derived from = = 0, and where 
ip = e - 2cb2 Q + cosh(2c6iAf). For Q ^ and M ^ 0, 
Eas. l(T^|l are solved to give (6 = tanh(2c6iM)) 



2c6 2 



In 



— M 



M 



+ 1) 



(14) 



Eq.J^l) is put into ifT^ getting F as a function of M. 
Plotting this function for various 7 (or T ai where c and 
n = 2 are fixed) we select those minima of F which sat- 
isfy |jn]2); see Fig. ^ At some temperature T a = Ti the 
ferromagnet with Q > and M > first appears as a 
metastable phase (local minimum of F) . For T < T 2 this 
state provides a value of F lower than the paramagnetic 
— In 2. T 2 is thus the first-order phase-transition temper- 
ature, since Q and M jump at this point from Q = M = 
to some finite values. During this transition paramag- 
net remains locally stable; it, however, gets unstable for 
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and Jij do not have a common node. This holds as well 
for all higher order correlators of J's and is explained as 
follows: from J2JE1GJ we see that the conditional proba- 
bility for J factorizes, P{J\a) = Ili<fc P(JikW), because 
there is no direct J — J interaction in the Hamiltonian 
Thus J's can be correlated only due to fluctuations 
of the spins from one realization to another. 

The two-link correlator 82 = (JikJjk) — (Jik}(Jjk) (i 7^ 
j) is conveniently discussed for n — 1 (the more general 
and tedious expression leads to similar conclusions): 



FIG. 1: The difference AF between the ferromagnet and 
paramagnet values of F. On each curve the minimum corre- 
sponds to the stationary magnetization M. The curves refer 
to different temperatures and c = 7 = 1; from the top to 
bottom: T = 1.452, 1.445, 1.44. The top-line minimum cor- 
responds to metastable ferromagnet, the bottom-line one to 
the stable ferromagnet, while the middle line is drawn at the 
transition temperature T — T2, where AF = 0. 



cbi > 1, i.e., at some lower temperature T3 < T2, where 
T3 is determined from cb\ — 1. As an example: for c — 1, 
Ti = 1.457, T 2 = 1.445, and T 3 = 1.385. For c -► 15/4 
all these three temperatures merge to T3. In contrast to 
the thermal transitions, for the considered case n = 2 
the percolation transition (driven by cb\ = c&2 = c e ) is 
always first-order: at ci = 0.805 there first appears the 
metastable ferromagnet with Q > and M > 0. For 
c e > c! 



(2) 



0.824 it is truly (globally) stable. The para- 
magnet is (locally) stable till c e = 1. 

The structure of the network in the present model is 
a collective effect, since spins react on the links. The 
average of m distinct links is derived analogously to JBJ: 



T— r m 



j. 



(15) 



The transformation of l|15(l is illustrated for m — 1: i) 
Apply (JjJJ; ii) Recall that the model does not have any 
space structure and that all the links are equivalent, i.c, 
the linking probability (Jjfc) = Ai can be sought for as 
■^^2i^ k (Jik)- Hi) Neglect fluctuations of the macro- 
scopic quantities, e.g., ((2"=i °j) 2 ) = (2™=i °j) 2 - Tms 
general point of the statistical mechanics can be proven 
directly for the present model. The final formula reads 



Al = A 



nbiM 2 + 



n{n - 1)Q 2 



n = 1,2. (16) 



In the paramagnet Ai = cbo/N corresponds to the usual 
random graph with the effective connectivity c e = cbo- It 
increases — by jump for the first-order transition — in the 
ferromagnet. The reason for this increase is that once two 
spins are (in average) lined up, they get linked stronger. 
The same tendency is seen for the probability of two links. 
Instead of this quantity, it is more convenient to study the 
two link correlator (JikJij) — (Jik){Jlj)- It is zero if Ji k 



<52 = -^2&i(l-M 2 )M 2 >0. 



(17) 



82 is zero in the paramagnet, and thus {JikJjk) = 
c 2 b 2 ] /N 2 is again of the random graph form. In the fer- 
romagnet 82 is positive: if the nodes i and k are linked 
stronger than in average, i strongly links with j. 82 > 
also means that the links are attracted to the common 
node, since A x 8 2 = Pr[J lk = l\J jk = 1] - Pr[J lk = 1]. 

The probability A3 = (JijJj k J k i) to have three links 
forming a triangle is representative for n = 2: 



N 3 



2b\ 



b d 2 + 6QM 2 bf [b + b 2 + 2&i] 



6M 2 &! [hibo + b 2 ) + b 2 2 + b 2 ] + 3Q 2 [2b\ + b b 2 + b 2 b 2 ]}. 

In the paramagnet A3 = { 6g + 2b\ + b^} clearly de- 
viates from the random graph behavior c 3 6q/7V 3 . In the 
ferromagnet A3 increases, by a jump if the transition is 
of the first order. The effect of clustering (informally: 
friends of our friends are our friends) is when two nodes 
already connected via a third node tend to establish a 
direct connection. It is characterized through a coeffi- 
cient K = Pr[Jy = l\J lk = l,J jk = 1] - Pr[Jy = 1], 
which is zero for the random graph. For our case 
K = {2& 3 + 62} > in the paramagnet, thus defining 
a type of short-range order. The random graph behav- 
ior is recovered only for very high temperatures where 
b r = cosh"(/37) tanh r /?7 — > for r > 0. In the ferro- 
magnet K first increases, but goes to zero for Q, M — > 1. 
The case n = 1 — where the system is in global equilib- 
rium and the time-scale separation is irrelevant — is ex- 
ceptional, since here the clustering in the paramagnet is 
absent: K = &f (61 + 2b )M 2 (l - M 2 ). 

Another relevant quantity for the network is the degree 
di = J2 k Jik of node i (note (di) = Ai). For the random 
graph the degrees of different nodes correlate very weakly, 
(didk) — (di)(d k ) oc 1/N, and the distribution of di is 
Poissonian: P(d) — e~ c ^j 0. The first feature holds in 
our model due to domination in (did k ) of links without 
a common node. The second feature holds only in the 
paramagnet; see f° r details. 

Discussion. We studied a model for statistical network, 
where both nodes and links are active variables influenc- 
ing each other. The nodes can be in two states (spin up 
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or down) and the like nodes tend to link. Important as- 
pects of the model are i) time-scale separation: the nodes 
change faster than the links and ii) non-equilibrium: the 
temperatures of the nodes (T a ) and links (Tj) are dif- 
ferent. The phase structure of the model crucially de- 
pends on whether the reaction of the nodes on the links 
is more {n = T a /Tj > 1) or less {n < 1) pronounced. 
For the first case the spins modify the links and create 
persistency: the phase transition to the ferromagnet is of 
first order; paramagnet (ferromagnet) is metastable be- 
low (above) the transition point. This bistability implies 
hysteresis and memory: when changing the temperature 
not very slowly, the final state of the system (para or 
ferro) depends on its initial state. The transition be- 
comes second-order, realized by instability of the para- 
magnet, either if the network is dense, or if n < 1. For 
ri — > no reaction of the nodes on the links is present, 
and we return to Ising ferromagnet on the (Erdos-Renyi) 
random graph [lCj . 

The network is clustered already in the paramagnet: 
two nodes connected via a third one, tend to link directly. 
In the ferromagnet there are link-link correlations: two 
links having a common node attract each other. The con- 
nectivity (linking probability), clustering and link-link 
correlations increase during the phase transition and can 
serve as alternative order parameters. 

The model can simulate the magnetostriction effect 
for disordered magnets. For the Ising model on regu- 
lar lattices the effect was studied in Refs. 11] and used 
to explain experiments on crystals of MnAs, NH4CI, etc, 
which also display striction-driven change of the ferro- 
magnetic transition order from the second to the first. 

Yet another application can be modeling the opinion 
formation, a sociological subject that recently got an in- 
put of physical ideas |ljj. Here the spin ui — ±1 refers 
to two opinions each agent may have. It is influenced 
by the (social) noise at temperature T . The concrete 
manifestation of "agents" and "opinions" may be voting, 
propagation of fashion, investment, etc. The agents inter- 
act within slowly changing social network J. The ferro- 
magnetic interaction describes the herding-collaboration: 
like-minded agents tend to connect; linked agents impose 
their opinion on one another. The linking costs energy, 
as given by the term a a in QJ. As compared to various 
applications of statistical physics models to the opinion 
formation [lflj . our approach emphasizes the collabora- 
tion aspect of the like-minded agents and the dynamical 
character of the involved social network; see f° r some- 
what related ideas. Here is an outline of our results in 
the opinion formation context. 

The paramagnetic phase corresponds to a plural soci- 
ety, where each agent has his own opinion. Herding and 
collaboration are not efficient either because linking is 
too costly, or noises are too strong. Still, there is a short- 
range order: three (not less!) agents tend to connect and 
to share one opinion. For weaker noises or less costly 



linking the herding behavior starts to dominate. If the 
influence of the agents on the linking is not pronounced 
(n < 1) the majority of agents coherently forms a single 
opinion driven by weak external influences (spontaneous 
second-order transition). Below the transition, almost no 
agent disagrees with the majority. For pronounced influ- 
ence on the linking (n > 1) the plural society survives 
the first-order transition (i.e., jump-like dominance of a 
single opinion) and slowly decays on a long time-scale. It 
gets unstable upon further decrease of the linking cost. 
We see that revolutionary (jump-like) changes can oc- 
cur in response to smooth variations of external condi- 
tions in societies with strong trends to establish groups 
of like-minded agents. Such changes can be prevented if 
the infrastructure network is dense enough. Within the 
single-opinion dominated society strongly linked agents 
tend to be linked even stronger, and tend to link directly 
with indirectly related agents. The connectivity in this 
phase is larger than in the plural phase. 
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